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(N ■ Abstract 

We consider products of independent large random rectangular matrices with in- 
dependent entries. The limit distribution of the expected empirical distribution of 
singular values of such products is computed. The distribution function is described 
by its Stieltjes transform, which satisfies some algebraic equation. In the particular 
case of square matrices we get a well-known distribution which moments are Fuss- 
' Catalan numbers. 

1 Introduction 



Let m > 1 be a fixed integer. For every n > 1 consider a nondecr easing set of m -|- 1 
integers po = n,pi,--- ,pm. where pi, = Pu{n) for v = l,...,m, depending on n and 
Pu > n. For every ?i > 1 we consider an array of independent complex random variables 
xj^'*, 1 < J < Pu-i, 1 ^ k < Pu, V = l,...,m defined on a common probability space 

{0„,F„,Pr} with EXj^' = and let E \xfi}\ = 1. Let X^'^) denote the p^-i x p^ matrix 
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shev Laboratory." Partially supported by CRC 701 "Spectral Structures and Topological Methods in 
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1 



with entries [X^] = -^xf^ , for 1 < j < < k < Pu- The random variables 

Xj'^ may depend on n but for simphcity we shall not make this explicit in our notations. 
Denote by si > . . . > the singular values of the random matrix W := ]^^;^ X^*^) and 
define the empirical distribution of its squared singular values by 



1 " 



n 
k=l 



where I{b} denotes the indicator of an event B. We shall investigate the approximation 
of the expected spectral distribution F^ix) = E by the distribution function Gy{x) 

which defined by its Stieltjes transform s-y{z) in the equation (jl.2p below. 

We consider the Kolmogorov distance between the distributions i^„(x) and Gy{x) 

An ■■= sup \Fn{x) - Gy{x)\. 

X 

The main result of this paper is the following 

Theorem 1.1 

for any r > 

Ln{T) ■= max — E iX^t^-'P/,, ^{^),^ ^,^0 as n ^ oo 

^' u=l,...,m ^ ^ ' ' {\XL'\>T^} 

j=i k=i 



Theorem 1.1. LetBX^l^ = 0, E|x]^^|2 = 1. A ssume the Lindeberg condition holds, i.e. 

Pv-l Pv 



Assume that lim„_^oo = yi £ (0, 1]. Then. 



lim sup \Fn{x) — Gy{x)\ = 0. 

n— >-oo J. 

Remark 1.2. For m = 1 we get the well-known result of Marchenko-Pastur for sample 
covariance matrices 

Remark 1.3. In the case 2/i = ^2 = ■ ■ ■ = Um = 1 the distribution Gy has moments 
defined by 

Mk= r x^dGy{x) = ^—-( ,^ ,Y 
Jo ' mk + l \mk + k) 

the so called Fuss-Catalan numbers. 



^mk + kj ^ 

The Fuss-Catalan numbers satisfy the following simple recurrence relation 



fcoH 1-^771=^-1 i/=0 

Denote by 5(2;) Stieltjes transform of the distribution G determined by its moments M^,, 

s{z) = / dG{x). 
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Using equality (jl.ip . we may show that this Stieltjes transform s{z) satisfies the equation 

1 + zs{z) + {-ir+^z"'s{zr+^ = 0. 

In the general case {yi 7^ 1) Stieltjes transform satisfies the following equation 

m 

1 + zsyiz) - s{z) J](l -yi- zyisyiz)) = 0, (1.2) 
1=1 

where < yi < 1. For more details about the moments of such distributions see [3]. 

The result of Theorem [TTT] is the first attempt in the Random Matrix Theory to describe 
the asymptotic of distribution of the singular spectrum of a product of rectangular random 
matrices. For rectangular random matrices there is no easily available analog in free 
probability to describe the limit law. The Theorem 11.11 was formulated in [2]. In the case 
of squared matrices (yi = 2/2 = • • • = ym = 1) there is an analog in the form of product 
of so-called free 7^-diagonal elements. It was studied for instance in Oravecz, |12] . It is 
well-known that the moments of distribution of a product of free 7^-diagonal elements are 
Fuss-Catalans numbers (compare Remark ll.Sp . In [1] it has been shown by the method 
of moments that the limit distribution of singular values of powers of random matrices 
is the distribution Gy with yi = ■ ■ ■ = ym = 1. In Banica and others [1] the result of 
Theorem 11.11 was obtained for square Gaussian matrices (see Theorem 6.1 in [3]), using 
tools of Free Probability theory. For a description of the distribution of Gy for the special 
case yi = • • • = ym = 1) see Speicher and Mingo [13] as well. 

In the the following we shall give the proof of Theorem 11.11 We shall investigate the 
Stieltjes transform s„(z) of distribution function F„(x). We show that s„(z) satisfies an 
approximate equation 

m 

1 + ZSn{z) - Sniz) JJ(1 - yi - ZyiSn{z)) = 5n{z) 
1=1 

where 5„(z) — )■ as n — )• 00. This relation together with relation (jl.2p implies that Sn{z) 
converges to s{z) uniformly on any compact set in the upper half-plane /C C C"*". The 
last claim is equivalent to weak convergence of the distribution functions Fn{x) to the 
distribution function Gy{x). 

By C (with an index or without it) we shall denote generic absolute constants, whereas 
C( • , • ) will denote positive constants depending on arguments. 

2 Auxiliary results 

In this Section we describe a symmetrization of a one-sided distribution and give a spe- 
cial representation for symmetrized distribution of the squared singular values of random 
matrices. Furthermore, we prove some lemmas about truncation of entries of random 
matrices. 
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2.1 Symmetrization 

We shall use the following "symmetrization" of one-sided distributions. Let be a pos- 
itive random variable with distribution function F{x). Define ^ := where e denotes a 
Rademacher random variable with Pr{e = ±1} = 1/2 which is independent of ^. Let F{x) 
denote the distribution function of ^. It satisfies the equation 

= 1/2(1 + sgn{x}F(x2)), (2.1) 

We apply this symmetrization to the distribution of the squared singular values of the 
matrix W. Introduce the following matrices 



Here and in the what follows A* denotes the adjoined (transposed and complex conjugate) 
matrix A and 1^ denotes unit matrix of order k. Note that V is Hermitian matrix. The 
eigenvalues of the matrix V are —si, . . . , — s„, s„, . . . , si and pm — n zeros. Note that 
the symmetrization of the distribution function J-n{x) is a function J-n{x) which is the 
empirical distribution function of the non-zero eigenvalues of matrix V. By ()2.ip . we have 



A„ = sup|F„(x) - Gy{x)\, 

X 

where Fn{x) = E J>^(x) and Gy{x) denotes the symmetrization of the distribution function 

Gy{x). 

2.2 Truncation 

We shall now modify the random matrix X by truncation of its entries. Since the func- 
tion Gy{x) is continuous with respect to yi we may assume that yi = ^, I = 1, . . . , m. 
Furthermore, there exists a constants c > and C > such that Cn > pi > cn for 
any / = 1, . . . ,m. We note that there exists a sequence Tn — t- as n — t- oo such that 
■^Ln{Tn) — )■ as n — )• oo. Introduce the random variables Xj'^'^^ = -^j'k ^ ^^x'-i'^.^kct V"} 

and the matrix X^''''^^ = -^^(xj^''^^). Denote by s^^^ > ■■■ > the singular values of 

( \ ( ^ ( \ ( W*^'^) O \ 

the random matrix W''^-' := Ff™ i X'''''^'. Introduce the matrix V^'^-' := I r i* I- 

yO W*- ) 

We define its empirical distribution by T^\x) = ^ Ylk=i \s['^<x} + ^ ^^=1 \-s['^<xy 
Let Sn{z) and Sn\z) denote Stieltjes transforms of the distribution functions Fn{x) and 
F^ (x) = ETn (x) respectively. Define the resolvent matrices R = (V — zl) and 
J{_(<^) = (v(^) — zl)~^, where I denotes the unit matrix of corresponding dimension. Note 
that 

sniz) = ^ETYR+ and si^\z) = i-ETrR^ + if^. 

2n 2ymZ 2n 2ymZ 
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Applying the resolvent equality 

(A + B - ziy^ = (A - ziy^ - (A - ziy^B{A + B - ziy\ 

we get 

\s^{z) - sl^\z)\ < ^E|TrR('^)(V- V('=))JR|. (2.2) 
2n 

Let 

Introduce the matrices 

q=a q=a 

We have 

m— 1 

V - V(^) = ^ vg„i(H('') - h(^'^))V,+i,^. (2.3) 

9=1 

Applying max{||R||, HR^^^^H} < v~^, inequality (|2.2|) . and the representations (|2.3p to- 
gether, we get 

|.„(.)-«W(z)| < ^5]Ei||(X('^+i)-X('^+i'^))||i^E^||v(:J^iRRWv,+i,„||2. (2.4) 
• /n — ' ■\/n 

q=l 



Applying well-known inequalities for matrix norms, we get 

E||vg„,RR(^)V,+i,„||2 < ^E||vg^_,V,+i,™||i 

In view of Lemma I5.2|, we obtain 

E ||vg_iRR(^)v,+i,„||2 < ^. (2.5) 

Direct calculations show that 

1 r " 

-E||X(«) -X(-)||i < ^ E|xj?|2/^|^< < CLM. (2.6) 

j,k=i ' 



Inequalities (|2.4p . ()2.5p and (|2.6p together imply 



Kiz)-s^\z)\< ^^^\ (2.7) 



(c) 

Furthermore, by definition of XjjJ , we liave 

1 



ITT <r ir I -jr('J)|2 T 



This imphes that 

||EX('''^)||2 < -J^f^lBX^l'^l^ < (2.8) 

We denote H*-'^''^'' := ( ^ (X^'^'^^ EX*^^*^))*/ ^^"^ define the respectively matrices 
V^'^^ ^i'^fo- Denote by Fn\x) the empirical distribution of the squared singular 
values of the matrix V^^^J. Let sl''^(z) denote the Stieltjes transform of the distribution 
function F^^^ = ¥.F^^\ 



f 1 ~ 

Similar to inequality (I2.4p we get 



X — z 



Isl^^ -^^\z)\ < Y: ^||EX(^"=)|b^El||<RWRWvg 

q=0 



Analogously to inequality (|2.5p . we get 
By inequality ([M]), 

The last two inequalities together imply that 



(2.9) 



Inequalities p.7p and (12.90 together imply that matrices W and W^'^) have the same limit 
distribution. In the what follows we may assume without loss of generality that for any 
n > 1 and z/ = 1, . . . , m and any / = 1, . . . , m and j = 1, . . . pi-i, k = 1, . . . ,pi, 

EX^l^ = 0, EX^f = 1, and < ct„V^ (2.10) 

with 

r„ — >• and k > as n — )• oo. 

T 
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3 The proof of the main result for m = 2 

Recal that the matrices H^"^), q = 1, . . . ,m, and J are defined by equahties 

O I„ 



nil) 



X('') o 



•-P0 



•-Pm 

o 



and that A* denotes the adjoint matrix A and 1^ denotes the identity matrix of order 
k (sometimes we shall omit the sub-index in the notation of the unit matrix). Let V = 
ni^i H^'^^ V := Hg^i H^''') J, and let R(^) denote the resolvent matrix of the matrix V, 

R(z) := (V-zIp„+pJ-^ 

We note that the symmetrization of the distribution function Gy{x) has the Stieltjes 
transform Sy{z) (in the what follows we shall omit index y in the notation for this Stieltjes 
transform) which satisfies the following equation 



1 + zs{z) - £^ J](l - - zyis{z)) = 0. 



(3.1) 



First, we prove Theorem II. II for m = 2. We start from the simple equality 



1 + ZSniz) 



1 

2n 



ETrVJR(z). 



(3.2) 



Using the definition of the matrices V, H^'^) and J, we get 

-. 71 pi . Pi P2 



j=i k=i 



i=i fc=i 



(3.3) 



In the what follows we shall use the notation eniz) as generic error function such that 
|£n(2)| < By Lemma [STl in the Appendix, we get 



^ n pi 

i=i fc=i 

-1 Pl P2 



9H(2)JR 



kj 



j+pi,k+n 



(3.4) 



where \en{z)\<^. 

Put ni = max{2pi, n + ^2}- Let ei, . . . , e„j be an orthonormal basis of . First we 
note that, for j = 1, . . . , n and for k = 1, . . . ,pi 



jk 



1 



j^k 1 



1 



+Pl"^J+P2' 



(3.5) 
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and for j = 1, . . . ,pi and k = 1, . . . ,p2, 

duW _ 1 ^ aH{2) _ I T 

We first compute the derivatives of the resolvent matrix as follows 



^Re,e^H(2) JR - ^RH^^efc+p^eJ+p^ JR, 



aR 



^Refc+„eJ+p^H(2) JR - ^RH^^^e^-e^JR, (3.7) 



and 



dxf^ ^P2 ■ ""^ ^/P2 



a(H(2)jR) 1 „ 1 ^ .p-. 



^H(2)jRH(i)efc+p,eJ+p^JR, (3.8) 



and 



5(H(2)jR) It 1 r 

^ ^ = ^e,-e^JR - ^h(2) JRe,+,eJ+p^H(2) JR 

^H(2)jRH(^)eje^JR. (3.9) 



/P2 

The equalities p.3p and ()3.8p and ()3.9p together imply that 

l + ^s„(z) = Ai + A2 + ^3 + en(z), (3.10) 



where 



I n Pi I Pi P2 



■^^ j=l k=l ^ j=i k=l 



M := j;E[H(2)jRHW]fc,fc+p, J][JR],+p„,-, 

^"^P^ k=i j=i 

-, Pi P2 

^3 := J][H(2)jRH(^)]fc+p„fc J^[JR],-,+„. 

We prove that the first summand is negligible and the main asymptotic terms are given 
by A2 and A3. We mow start the investigation of these summands. 
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Lemma 3.1. Under conditions of Theorem \l.l\ we have 



< 



c 



-> E JR 



C 



< —A- (3-11) 



Proof. Applying Lemma 15.51 with m = 2 and a = 1 and Lemma 15.41 (see Appendix), we 
obtain 



+P2,j 



< E 2 



Pi 



Pi 



( ^[H(2)JRH(1)],,,+,, - E j;[H(2)jRH(i)],,,,+,, 

\k=l k=l , 



XE 2 



1 " 



< 



C 



Similar we prove the second inequality in (|3.1ip . Thus the Lemma is proved. 
Note that 



□ 



i=i j=i 

1 1 1 — 1/2 
~ X] E [JR]fe,fc+n = - E [R]j+n,j+n = Sn(^) — — • 



k=l 



2/2 ^ 



(3.12) 



Lemma 13. H equalities p.l2p and the definition of matrices H^*^), for = 1,2, together 
imply 



Pl P2 



= --.„(z)^-— = J^^Exg) [H(2)jR],.,+, + e„(z), 



(3.13) 



j=i k=i 



and similar 
^3 



n Pl 



(sniz) - ^):r^EEE^S^ [H(2)JR],+^^^. + ,,(.). 



Applying Lemma [STTl and equalities p.5p - (|3.9p . we get 

-, Pl P2 

A2 = -(pi - [H(2) JRH(1)],j) E [JR]fc,fc+n + ^4 + en{z) 

j=l k=l 
1 — 1 n 

^3 = -(sniz) - — 7^)^(^'i - EE[H^')jRH(i)]fc+p,fc+pJ J;E[JR],+p,,, (3.14) 

k=l j=l 

+ A5 + en{z), (3.15) 

where 

Pl P2 



J=l fc=l 

n Pl 



A = {sn{z) - ^^)-^5]5]E[H(2)jRH«]fc+,„,[JR]fc,,- 



Note that 

Pl Pl 

^E [H(2)jrh(i)],,,- + ^E [H(2)jRH(i)]fc+p,,fc+p, = ETrH(2)jRH(i) 
i=i fe=i 

= ETrH(i)H(2)jR = ETrVJR. 

By resolvent equality I + zR = VJR, we have 

n P2 

— (J] E [h(i)h(2) JR],, + 5^ E [h(i)h(2) JR]^.+,,^.+„) = 1 + zs„(z). (3.16) 
^ i=i i=i 

Equalities ([321), (|XTil) and (fXT6]) together imply 

s (z) 

A2 + A3 = ^^(1 - yi - z2/is„(z))(l - - zy2Sn(2)) + ^4 + ^5 + £n{z). (3.17) 

z 

Lemma 3.2. Under condition of Theorem \l.l\ we have 

max{|^i|, IA4I, l^sl} < (3.18) 

Proof. We shall consider the bound for the quantity only. The others are similar. By 
Holder's inequality, we have 



|^4| < ^e||h(2)jr||2, 



where || • II2 denotes Hilbert-Schmidt norm of matrix. Continuing the last inequality, we 
may write 

|^4|<^E||H(2)||i. 
n V 
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I^5|< 3- 



A simple calculation shows that 

E||H(2)||| <Cn (3.19) 
The last two inequalities together imply 

C_ 

Thus the Lemma is proved. □ 
Relation p.l7p and Lemma [3^2] together imply 

1 + zsn{z) = -^^(1 - yi - zyiSn{z)){l - ^2 " Zy2Sn{z)) + (5„(z) (3.20) 
where \dniz)\ < + 

Lemma 3.3. Under conditions of Theorem M . 1\ for v > 3 we have for sufficiently large n, 

|,(,) _,„(,)! <^i^. (3.21) 
Proof. We rewrite the equation (|3.2U|) as follows 

l + zsn{z) = -^Sn{z){l-yi){l-y2)-zsl{z) + s^{z){yi{l-y2) + y2{l-yi)) + 5n{z). (3.22) 
Introduce the notations 

(l-yi)(l-y2) 



d 



z 

dn = z{Sn{zf + Sniz)s{z) + s'^{z)) 

K = {s{z) + Sn{z)){yi{l - 2/2) + ^2(1 - yi))- 
Then we may rewrite equality (|3.22p as follows 



Sn{z) - s{z) 



-Z + d + dn + hn 

First we note that 

lm{d} < 0. (3.23) 

Furthermore, note that 

Ei||y||^ 1 

|^Sn(^)|<l + ^M<i + _. (3.24) 

nv V 

Using that max{|s(z)|, |srt(-z)|} < ^ and ()3.24p . we get 

m&x{\hn\, \dn{z)\} < (1 + i)i (3.25) 
We take v > 3. Equalities (13.23^ . (|3.25p together complete the proof of lemma. □ 
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The last Lemma implies that in there exists an open set with non-empty 
interior such that on this set converges to s{z). The Stieltjes transform of our 

random variables is an analytic function on and locally bounded (that is |s„,(z)| < 
for any v > 0). By Montel's Theorem (see, for instance, [16], p. 153, Theorem 2.9) Sn{z) 
converges to s{z) uniformly on any compact set /C C C"*" in the upper half-plane. This 
implies that A„ — t- as n — )• oo. Thus the proof of Theorem 11.11 in the case m = 2 is 
complete. 

4 The proof of the main result in the general case 

Recall that H^'') and J are defined by following equalities, with q = 1, . . . , m, 

^ " Vo x('"-^+i)V ' " [ip, o ) ' ^^-^^ 

where 1^ denotes the identity matrix of dimension k. Note that H^"^) is a {pq~i +Pm~q+i) x 
(pq+Pm-q) -matrix. Let V = H'^'?\ V := VJ, and denote by R its resolvent matrix, 

R := (V - ziy^. 

We shall use the following "symmetrization" of one-sided distributions. Let be a posi- 
tive random variable. Define ^ := where e denotes a Rademacher random variable with 
Pr{e = ±1} = 1/2 which independent of ^. We apply this symmetrization to the distri- 
bution of the singular values of the matrix X^. Note that the symmetrized distribution 
function -F„,(x) satisfies the equation 

F„(x) = 1/2(1 +sgn{x}F„(x2)), 

and this function is the empirical spectral distribution function of the random matrix W. 
Furthermore, we note that the symmetrization of the distribution function G{x) has the 
Stieltjes transform s(z) which satisfies the following equation 

1 + zs{z) -^Yl{l-y,- zy,s{z)) = 0. (4.2) 

In the rest of paper we shall prove that Stieltjes transform of expected spectral distribution 
function s„(z) = ^^dEF„(x) satisfies the equation 

1 + zsniz) - ^ 11(1 -Vu- zy^sniz)) = ,5„(z), (4.3) 

where (5„(z) denotes some function such that 5n{z) — )• as ?i — )■ oo. 
We start from the simple equality 

I + zsn{z) = —TiWn. (4.4) 
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By definition of tlie matrices V, H^"^) and J, we get 

-. PO Pl 



j=i k=i 

Pm — 1 Pm 

+ o„ /TT- Yl E^^ifc'^['^2,mJR.]j+pi,fc+po' (4-5) 

where V^^^ = ng=a H^'^^. To simpify the calculations we assume that X^l^ are i.i.d. Gaus- 
sian random variables, and we shall use the following well-known equality for a Gaussian 
r.v. ^ 

E^/(0 = E/'(e), (4.6) 

for every differentiable function f{x) such that both sides exist. By Lemma [5 .71 we obtain 
that the error involved in this Gaussian assumption is of order 0(r„). Recall the notation 
£n{z) for generic error functions such that |en(-2)| < CTnV~'^, for some q > 0. Let pQ = n 
and ni = maxo<^<m-i{j'v +Pm-u}- Let ei, . . . , be an orthonormal basis of M^'^. First 
we note that, for j = 1, . . . ,Pg-i and k = 1, . . . ,pg, 

9H(9) _ 1 jn 9H("^-''+i) _ 1 y 
and, for j = 1, . . . ,p^m-q and A; = 1, . . . ,Pm-q+i 

Now we may compute the derivatives of the matrix V2,.mJR' as follows 

5(V2,mJR-) 1 T 1 2- 
Tn ~ -^^^ 2,m.-l^k+pm-i^j+pm'*"" ;= V2,mJ-rLeje;j V2,mJ-tv 



^Pl .... 



1 r 



and 



V2,mJRVi,m„iefc+p^_je^-+p^ JR. 

(4.9) 



9(V2,mJR) _ 1 ,^ Tt-d t-d T at t-d 

: V2,m-iejej!. J±t 2,m'itlek+n^j+p-^ V2,m-lJ-K' 



dx'^T^ ^JPm ' " ^Pm 



jk 



1 



/Pr 



:V2,„JRVi,„_iejepR. (4.10) 



The equalities (j4.5p and ()4.9p together imply 

1 + zs„(z) = + A2 + ^3 + -Bi + B2 + S3 + en(2), (4.11) 
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where 



^""^^ fc=l j=l 



-. n Pi 

j=l fc=l 



^ Pi 

^""^1 fc=l j=l 



and 



j=l fc=l 



^9 



j=i fc=i 



Pm-l Pn 

2 

jr'+pi,A:+n' 



-j^ Pm-l Pm 

B'i := — E ^ [V2,mJRVl,m-l]j+pi J y^[JR]fc,fc+n- 

J=l fc=l 

Lemma 4.1. Under the conditions of Theorem \1.1\ there exists a constant C > such 
that the following inequality holds 

max{|A2|, \B2\} < (4.12) 

Proof. Note that 

\A2\ < ^E ||V2,„JR||i < 4^E ||V2,^||i (4.13) 

By Lemma l5.2t 

E||V2,^||i<Cn (4.14) 

The last two inequalities conclude the proof. The bound for \B2\ is similar. Thus the 
Lemma is proved. □ 

Lemma 4.2. Under conditions of Theorem \1.1\ there exists a constant C > such that 
the following inequality holds 

C 

max{|Ai|, \Bi\} < — . 

Proof. We consider the quantity Ai only. The bound for Bi is similar. By Lemma |5.5^ 
we have 

Pi ^ n ^ 
1^1 ~ 7, / ^ E [Vi m-l]A;,fc+n— / ^ E [JR]j+„ j| < ^. 

k=i j=i 
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Direct calculation shows that 

E [Vl,m.-l]k,k+n = 0. 

Thus the Lemma is proved. □ 

Lemma 4.3. Under conditions of Theorem li.il there exists a constant C > such that 
the following inequality holds 

Pi ^ n Q 

l^3 + ^EE[V2,,nJRVl,„_l]fc,fc+,_,-5]E[JR],+p„,,| < 

k=l 3=1 

^ Pm—l ^ Pm ^ 

I-S3 + — / ^ E [V2 .mJRVi m-l]fc+pi,fc / E[JR]j ,-+„| < TT. 

In ^-^ Pm n-v^ 

k=l j=l 



Proof. Applying Holder's inequality and Lemmas 15.51 and 15.41 together, we get 

pi 

E[V2.„JRVi. 

n 

Pi Pi 

k=l k=l 

c 



^ Pi ^ n 

fc=i j=i 



< E2|--(^[V2,™JRVi 

,m— l]fc,fc+Pm_l ,m— l]fc,fc+Pm-l 

fc=l fc=l 

n 

„ 1 , i ,\: 

X 

' n ^ 

i=i i=i 



.i — . — -„ . ^^2 



Thus the Lemma is proved. 



□ 



Introduce the following notations, for a, /3 = 1, . . . , m, 

P0L-\ ^ pp 

fa, 13 = / ^ E [Va^mJKVi «]fc^fc+p„, QaR = / E [Va,mJ'i^l,l3]k+Pa^i,k, 

and 

^ Pm n 

fm+lfi = E -E [JR-]fc,fc+po' 9m+lfi = — E-E [JR-]fe+Pm,fc5 

P"" k=l k=l 

It is straightforward to check that 

Pm 



1 1 

/m+1,0 = E"^ [R]fe+n,fc+n = -(1 — Um — ZymSn{z)), 

Pm -^^ Z 

1 " 

Qm+lfi = — E E = Sn{z). (4.15) 

'nr\ ^ 
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By Lemma 14.31 and equality (|4.15p . we may write 

A3 + B3 = -^Sniz)f2,m-l " ^{-ymSn{z) + ^^"' )ff2,m-l + £n{z). (4.16) 

Now we investigate the behavior of the coefficients fa,m-a+i and ga,m-a+i, for a = 
2, . . . ,m. Assume that a < m — a. We have 



^ Pa-1 Pa 

fa,m~a+l = — ^ ^"^^i.fc JKVi^m-a+l] fc J+Pm-ti+i 



Pm — a Pm — CK+l 



9a,m~a — ,m— a+l] j+Pa-ijfc- 

(4.17) 



It is straightforward to check that 

<9(Va+i_mJR.Vi^m-Q+l) _ 1 



dX) 



V Pa V Pa 



1 



/Pa 



-^VQ,+i^mJR'Vl,m-oefc+p^_^eJ^_p^_^^^ Vm-a+2,mJR'Vl^m-Q+l• 
/Pa 



and 

C^(VQ,+l,mJRVi m_Q,) 1 y 

- : VQ,+i,m-aejefc Vm-a+2,mJH.V < m - a\ 



^^jrr"^'^ VP™-a+l 

H Va+l,mJRVl,a-iefc+p^_^ej_),p^Va4.1^m-a+l-^{Q^ < m — a} H -—Ya+l,mJ^!iyi,m.-aGjGk 

y/Pm—a+1 yPa 

1 y 



Applying the Lemmas 15.71 and 15.51 we obtain the following relation 

/a,m+l-a = + . . . + -D5 + e„(z), 



1 ^ 

,m— « ,m— a+1 • 
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where 

Pa Pa-1 



Dl = E y^[Va+l,m-a]A;,fc+p^,c [Vm-a+2,m JRVi,m-a+l]i+Pm-Q+i,j+Pm-a+i-^{« ^ ' 

^ Pa-l Pa 

,a-\\k,'j\y a+l,m-a+l\k,j+pm-a+i-^ {'^ < m — a} 

^ Pa 

D3 = ^ E [Va+l^mJ'i^l,m-a]k,k+p^-a 

k=l 

^ Pa-l Pa 

,a—l\k,j\y^ a+2,m,^'^^^ l,m—a\k,j+prn-a+l 

^ Pa 

D5 = E y^[Va+l,mJR-Vl,m-a]fc,fc+p^-a 



Pa-lPa 

Pa-l 

^ ["V"m-Q+2,mJKV"i^m-o+l]j+pm_a+i ,j+p„i_a+i- 

Similar we get the representation for ga,m-a- 

9a,m+l-a = Di + . . . + D5 + Eniz) , 

where 

Pm — a Pm — o: + 1 

1,771— a]j+pa,j ^ ^ [Vm-a+2,mJRVi_m_a_|_i]fc^fc/{a < 771 — a} 

Pm—a+lP7n—a . , , , 

j=l fc=l 

^ Pm — dPm — Q + l 

,a~l]j+pa,k+pa-i[^a+l,7n-a+l]j+pa,kI{oi < ni ■ 

Pm — a 



D3 — E [Vq,+i m JH-Vi m-o] 



Pm—a 



j+Pa,j 



J = l 

Pm — a. Pm — a + 1 



I' III, 1^ f III, (-t-p-L 

-^^4 = E ^ ^ [Va+i^mJRVi^a_l]j+p^_fc+p^_j 

j=l fc=l 

X a+2,7n.'^^^l,rn-a+l]j+pa,k 

^ Pm — cv Pm — CK + 1 

^5 = E Y [Va+l,mJRVl 

,771— a]j+Pa,j 

-Q+2,m.JRVl 

Pm—a+lPm—a ■ , , 

j = l k=l 

Lemma 4.4. Under the conditions of Theorem li.il there exists a constant C > such 
that the following inequality holds 

max{|Z)2|,|:D2|} < — 
nv 
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and 

max{|Z)4|,|:D4|} < 



nv"^ 



Proof. We describe the bound for D2 first. Applying Holder's inequality , we get 



-C2I < ||VQ+i^mJRVi^Q_i||2||Va+i 



n 



m—a\\2 



Applying Holder's inequality again, we get 
Applying Lemma 15.21 now, we obtain 



m < -. 

nv 

Recall that || • II2 denotes the Frobenius norm of a matrix. The proof of the bound for D2, 
D4 and D4 are similar. Thus the Lemma is proved. □ 

Lemma 4.5. Under the conditions of Theorem there exists a constant C > such 
that the following inequality holds 

max{|Di|, |;Di|} < — . 

nv 



Proof. Applying Holder's inequality and Lemma [531 we get 

Pa-l 

E 

Pa-l 

c 



\Di - — -E [Va+i ,m—a\k,k+p. 
7 = 1 

Pa 

^~^[^rn.-a+2,m JRV"l,m.-a]j+pni-Q+i,j+Pm-a+i I — 



Pa — 



Thus the Lemma is proved. □ 

Lemma 4.6. Under the conditions of Theorem \l.l\ there exists a constant C > that the 
following inequality holds 



Pa 

E ' 

Pa-l ^ 



D5 + — E ^[V,+i,^JRVi 

,m—a\k,k+p> 
, Pa-l 



^ E 2^ [Vm-a+2,mJ'i^l,m-a+llj+p,^-a+i,j+Pm.-a+i 

Pa-l 



^ 2- 

nv^ 
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and 



Pm — a 

^5 + E ^ [Va+l^mJ'^l,m-a]j+pm-c,,j 

^ Pm — a.-\-l 



Pm~a+1 



m-a+2,m'i^^l,m-a+l]k,k 



k=l 



< 



c 



nv 



2 ■ 



Proof. Applying Holder's inequality and Lemma 15.51 we conclude the result. 

Using the obvious equality Tr AB = TrBA, it id straightforward to check that 

Pa-l 

E [Vm-o+2,mJKV"i^m-a+l]j+p„j_Q+i,j+p„i_Q+i 



□ 



Pa-l 



i=i 



Pm 

— ^ E [VJR]j+„ j+„ = 2/0-1(1 + ZSn{z)). 



This implies that 



1 ^ E [Vm_a+2,mJR'Vi^m-o+l] 



Pa-l 



j+Pm-a + l,j+Pm-a- 



^1 = (1 - Va-l - Zya-lSniz)) 



Lemmas I4.4fl4.6l and last equality together imply 

fa,m-a+l = -(1 - Va-l " Zya-is{z)) fa+l,m-a + £n{z). (4.18) 

Similar we show that 

ga,m-a+l = "(1 " Um-a+l " Zym-a+lSn{z))ga+l,m-a + en(2:)- (4-19) 

Note that 

1 77^ 1 1 
/m+1,0 = E [JR]fc fc+po = V'E [R]fc+n.fc+n = {I - Vm - ZymSn{z)) (4.20) 

k=l ^ k=l 



and 



^0 k=l j=l 

Equalities (HlB - ifOT]) together imply 

/2,m = (-1)"^+^- Uil-Vg- zy,sn{z)) + e„(z) 



(4.21) 



ir+^'^\[{l-y,-zy,sn{z)) + en{z). 



q=l 
m—1 



(4.22) 



9=1 
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Equalities (|4.16p and ()4.22p together imply 

1 + ZSniz) = (-l)-+lM£Z J] (1 - - Zy,Sn{z)) + Sniz). 

We rewrite the last equation as follows 

1 + ZSniz) + (-1)-^^^ Yli^-yg- zy.sniz)) = (4.23) 



z 

9=1 



Let Stieltjes transform s{z) satisfies the equation 



1 + ZS{Z) + (-1)- JJ(1 _ _ = 

^ 9=1 



Introduce the notations 



%=1 



i^— 1 m 
Qu ■■= s{z)Y[{l-yq- ZyqS{z)) Y{ 0--yq- ZyqSn{z)). 
q=l q=u+l 

Relations ()4.23p and (j4.24p together imply that, for 

Sn{z) - s{z) = f"^^^^^ ^ (4.24) 

^+(-i)'"-'Er=o^39 

Note that ^ 

max{|zs(2;)|, |2;s.„(z)|} < 1 + - 

V 

and ^ 

max{|s„(2:)|, \s{z)\} < - 

V 

Applying these inequalities, we obtain 

i<?,i<i(i + ir. 

We may choose v > m+ 1. Then ^(1 + i)*" < ^. If we choose v such that ^ < we get 

m 

|^ + (_l)-i^g^|>^. 
<?=o 
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This implies that, for f > Vi := 




\Sn{z) - S{Z)\ < ^'""^ ^' < CTn (4.25) 
V 

From inequahty (j4.25p we conclude that there exists an open set with non-empty 
interior where Sn{z) converges to s{z). The Stieltjes transform of our random matrices 
is an analytic function on C'*" and locally bounded (|s„(2;)| < for any v > 0). By 
Montel's Theorem (see, for instance, [16], p. 153, Theorem 2.9) Sn{z) converges to s{z) 
uniformly on any compact set IC C in the upper half-plane. This implies that A„ — )• 
as n — 7- oo. Thus the proof of Theorem 11.11 in the general case is complete. 



5 Appendix 

Lemma 5.1. Under the conditions of Theorem \l.l\ we have, for any A; = 1, . . . ,pa-i+pp, 
and for any 1 < a < (3 < m, 

E [V„,^]jfc = 

Proof. For a = (3 the claim is easy. Let a < /3. We consider the case j = 1, . . . ,Pa-i and 
k = 1, . . . ,pj3 only. The other cases are similar. Direct calculations show that 

. Pa Pa + 1 

^ il = lj2 = l i,8-c« = l 

Thus the Lemma is proved. □ 
In all Lemmas below we shall assume that 



EX 



('^^-O, E|X]^)|2 = 1, |x]^)|<cr„V^ a. s. (5.1) 



jk 



Lemma 5.2. Under the conditions of Theorem assuming 15. we have, for any 
I < a < /3 < m, 

E||V„,^||2 < Cn (5.2) 

Proof. We shall consider the case a < /3 only. The other cases are obvious. Direct 
calculation shows that 

„ n Pa-l Pa P/3-1 

E II v„.,iii < E E E ■ ■ ■ E E E ■ ■ ■ x^Z.^^ 

i=iji=ii2=i i/3_c=ifc=i 
By independents of random variables, we get 

E\\YaM\l<Cn 

Thus the Lemma is proved. □ 
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Lemma 5.3. Under the condition of Theorem \l.l\ and assumption 15. 1\) we have, for any 
j = 1, . ..pa-i, k=l...pi3 anr>l, 



\\2r ^ (-i 
■j+P/l II 2 ^ "-^r 



and 



E lleJVo.^/jlls'' < Cr, E \\e]^+p^_-JVa,l3\\l' < Cr 
with some positive constant Cr depending on r. 

Proof. By definition of the matrices ^a,/3: we may write 



(5.3) 
(5.4) 



|eJV„,^||2 



Using this representation, we get 



P/3-1 



ja=l i/3-l = l 



(5.5) 



E||eJV„,^ll2 



where 



2r 



1 



P/3 



VP 



P,8-l Pq 



E- E^n E - E E E ' 



/l = l l^ = \ q=\ \ja = \ i,8-l = l j^ = l j;3_i = l 



(5.6) 



(5.7) 

By X we denote the complex conjugate of Rewriting the product on the r.h.s of (j5.6p . 
we get 



ElleJV,,;3|l2 



2r 



^— \** -|— |- (i ) 



(5.8) 



j^i^i , ^5 and ji''^ , . . . , j^'^i J where j^*^^ , j'f' 



Q= 

where ^** is taken over all set of indices j!^^ , 

1, . . . ,pk, k = a, . . . , P — I, Iq = 1, . . . ,pj3 and g = 1, . . . , r. Note that the summands in 
the right hand side of ()5.7p is equal if there is at least one term in the product 15.71 which 
appears only one time. This implies that the summands in the right hand side of (|5.7p is 
not equal zero only if the union of all sets of indices in r.h.s of ()5.7p consist from at least 
r different terms and each term appears at least twice. 

Introduce the random variables, for u = a + 1, . . . , P — 1, 



.(r) (1) .(r)7(l) ^(r) ^(1) ^(r) " ^ (1) (1) ' ' ' ^ .(r) „.(r)^7(l) ^(l) ) ' ' ' ^ ^(r) ^(r) , 



(5.9) 
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and 

Aa) _ vV"-! Y^'^l Y^""^ Y"^ 

^Ai) Ar) 7(1) 7W - ^.Ac) ■ ■ ■ ^Ar)Ar) ^ {^W " " " ^^r) 
Jl viJl iJl viJl JJl Ja Ja+l J" 'Ja + l 

_ yiP) yW -yW -yW 

S (1) (r) ^(1) ^(r) —^.(1) ,-(1) ■(>-), ^7(1) , '■■■^7('-) , 

Assume that the set of indices ja^ , 

if"^ , • • • , 4"'' with multiplicities , • • • , A:^"'' respectively, /cj"'' + . . . + fc^"^ = 2r. Note that 
min{A;|"\ . . . , > 2. Otherwise, 

|EC^") .(r)->{i) -r(r)l = 0. By assumption ()5.ip . we have 



. .(a) ■ ■ ■ 


^Ar)Ar) 




Ja Ja+l 


^.(1) ,-(1) 


yW) 
J0-1' 


AA 7(1) 


t ■ ■ ■ 1 Ja 



|ECS .mI<C(t„V^)2-2*. (5.10) 

Similar bounds we get for lEC^j^i'') .(r) -^(i) '^(r) I- Assume that the set of indexes 

J/3-i'---'Ji >i/3-i'---ii^_ii'? 

• • • >4-i, • • • contains tp-i different indices, say, if . . . , if^_^ with 
multiplicities 

• • • , ^Ijlj respectively, k^f ^'^ + . . . + k\^\^ = 2r. Then 

|EdS ^„ J < C(r„V^r-2*''- (5.11) 

Furthermore, assume that for a + l<;/</3 — 2 there are different pairs of indices, say, 
)i • • • {^tpA'tp) in the set 

{ja^ ,---,ja\ja\---, ja^ , • • • , 4-1 ' ' ' ' ' 4"! ' 4"! ' ' ' ' ' 4"! ' ^1 ' i ^^^^ multipHcitieS 

/ti''^ . . . , A;^;;^ Note that 

k'l^ + ... + ki'^'^=2r (5.12) 

and 

|EC?i) ,-(1) Ar)-(i) 7W 7(1) ^mI < C(-rnV^)^''"^*''- (5-13) 
Inequalities (|5.1U|) - (|5.13|1 together yield 

IE fl^!;i 7(.) 7(. J < C(r.V^)-('^-)-(*^+--^*.-"). (5.14) 

It is straightforward to check that the number M^ta, ■ ■ ■ , tp) of sequences of indices 

ii^^^ 7-^"^ 7^^^ i^^^ i^"^ 7^^^ 7^''^ u I \ with t tR of 

different pairs satisfies the inequality 

AA(t„,...,t^) < Cn*"+■■■+*^ (5.15) 
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with l<tj<r, i = a, . . . , (3. By the assumption of Theorem ll.H we have 

cn < py < Cn (5.16) 

for any = 1, . . . , m. Note that in the case ta = ■ ■ ■ = th = r the inequahties (j5.10p - (|5.13p 
imply 

EC (i) (r) (1) Ar):.(i) 7M 7(1) 7(r) < (5.17) 

Inequalities ()5.15p , ()5.14p , ()5.17p , and the representation (I5.6p together conclude the proof. 

□ 

Lemma 5.4. Under the conditions of Theorem \l.l\ assuming Ii5.1\) . we have 

E|i(TrR- ETrR)| < 
n nv^ 

Proof. Consider the matrix X^'^'-'^ obtained from the matrix X^'^) by replacing the j-th 
row by a row with zero-entries. We define the fohowing matrices 

H(-'i)=HH-e,-ejHH, 

and 

For simphcity we shall assume that v < m — ly + 1. Define 

q=l q=v+l q=m—u+2 

We shall use the following inequality. For any Hermitian matrix A and B with spectral 
distribution function Fa{x) and Fb{x) respectively, we have 

|TV(A - zl)-' - TV(B - ziy'l < ^^"'^(^-B) . (5.18) 

V 

It is straightforward to show that 

rank(VJ - V^^^'^^J) < 4m. (5.19) 
Inequality ()5.18p and (j5.19p together imply 

I — (TrR-TrR(^j))| < — . 
2n nv 

We may now apply a standard martingale expansion technique already used in Girko 

[7]. We may introduce cr-algebras J>j = a{Xi^\ j < I < py^i,k = 1, . . . ,py; X^^j^ , 

q = v + 1, . . . m, p = 1, . . . ,Pq_i, k = 1, . . . ,pq} and use the representation 

TrR - ETrR = ^ ^(E^j^iTrR - E,,jTrR), 

u=l j=l 

where ^uj denotes the conditional expectation with respect to the a-algebra F^j- Note 
that Fu,p^_^ = Fy+ifl □ 
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Lemma 5.5. Under the conditions of Theorem \l.l\ we have, for 1 < a < m, 

Pm — a Vm — OL 

- E ^ [V^+i,^JRVi 

^m—cx\kk-\~poL ) I — 



Pm—a Pm—a ^ 

^■z — • ■ - . ^ — ^- . - - 

k=l k=l 

and, for 1 < a < m — \, 

2 



E 



,m—a+l\kk I 



Proof. We prove the first inequality only. The proof of other one is similar. We introduce 
the folowing matrices, for z/ = 1, . . . , m and for j = 1, . . . ,Pu^i, X^'^'-^^ = X'^''-' — ej-ejx^'^^ 
and H('^'J) = H(^) - e^ejH^'^) and 

jj(m-i.+i,j) ^ _ H(™-'^+i)e,-+p ^,ej,„ . Note that the matrix X('^J) is 

obtained from matrix X^*^^ by replacing all entries of the j-th row by 0. Similar to the 
proof of the previous Lemma we introduce matrices ^^^'P by replacing in the definition of 
the matrix Vc,d the matrix H^'^) by H^'^'^) and the matrix Yl^rn-u+i) j) _ ^ot 

instance, for c < u < m — u + 1 < d, we get 

y—l m—v b 

q=a q=u+l q=m~y+l 

Define as well V('^J) := vj^;;^^ and R(j) := (V('^J) - zl)"^. Consider the following 
quantities, for = 1 . . . , ?n and j = 1, . . . ,Pu-i-, 



Pm — a 

. _ . . A^^j) .TR(''.i)v(^'-^') 

k=l k=l 



We represent it in the following form 



^ ._ ^(1) , ^(2) , ^(3) 
■- "T ^ > 



where 



E [{^a+l,m - ^a+l,m)'^'^ l,rn-a+l\k,k+p^, 



X^ \(\r _ _ 

k=l 

Pm — a 



A:=l 



Pm — a 

'"fj = E ['^i+l,mJR^'''^^('^l,ni-a+l - ^ i^m-a+l)]kk+pc.- 
k=l 
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Note that 

By definition of tlie matrices H'''-^ and H™"'^"''^'-^ , we liave 



k=l 



where 

" Vo O 

This equality implies that 

+ I ['^m-i/+2,m'i'i!^l,rn-a+l'i'^a+l,m~u+l]j+p„-i,j+p„^i\- 

Using the obvious inequality Yl]=i'^'jj — II -^11 2 ^'^y matrix A = (ajk), j,k 
1, . . . , n, we get 

n 

Ti := ^E|4'f <E II V,+i,„JRVi ,m-a+l JVfl+i^jy II2 



+ E ||Vm-i/+2,mJRV"l,m-a+lJ"V"a+i^m_i,+i||2. 



By Lemma 15.21 we get 



Ti < Va+l,m^l,m^a+l I < ^ 5.20 



Consider now 



n 



(2) 1 2 



Using that R - R^^) = -R(-')(V - V(''J))R, we get 

Pa-l 

k=l 

< [JH^"'^^^ VQ,+2,m-«H*^"^ ""''^'■^'■'Vm_o+2,mRV"i^m-aV^^-|^^^JRVi^Q,]jj. 

This implies that 

t(2) < (:7E||[V,+i,^JRVi,6Va,™JRVi,,||i. 
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It is straightforward to check 



r(2) < E ||Vi,„JH("+i) V„+2,m-aH("^-°+i'^')v„_„+2,m||i = E IIQIli 



(5.21) 



The matrix on the right hand side of equation (15.2ip may be represented in the form 



where = or = 1 or = 2. Since Xs'P = 0, for x = 1 or x = 2, we have 

e|hH^,P<-. 

n 



This imphes that 
Similar we prove that 



T2 < Cn. 



T3:=5^E|Hff <Cn. 
Inequahty ([OO]) . (|5:22]l and (fOS]) together imply 

n 

j;E|H,p<Cn 



(5.22) 
(5.23) 



Applying now a martingale expansion with respect to the a-algebras J-j generated the 
random variables X^^^'^ with 1 < k < j, 1 < I < n and all other random variables x'^'^^ 
except q = a + 1, we get 

1 

E|-(V[V,+i,^JRVi, 



k=l 



,m-a]kk+n — E V"^ [Vq+i ^ JKV"i m_Q,]fcfc_|_„) ^ < j. 



Thus the Lemma is proved. 



□ 



Lemma 5.6. Under the conditions of Theorem \l.l\ we have, for a = 1, . . . ,m, that there 
exists a constant C such that 



3 

712 



Pa-l Pa 



j=i k=i 



l^7fc ^ik I 



jk 



< CTr,V~ 
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and 



3 

712 



E 



Pm — oc Pm — a-\-l 



j=i k=i 



92(V,+i,^JRVi 



< CTr,V~ 



(5.24) 



where and x'^^ are r. v. which are independent in aggregate for a = 1, . . . ,m and 
j = 1, . . . ,Pa~i, k = 1, . . . ,Pa, and are uniformly distributed on the unit interval. 
By — ^— r^A(6',-?'*X,-f'*) we denote the matrix obtained f 



rom 



by replacing its entries 



Proof. The proof of this lemma is rather technical. But for completeness we shall include 
it here. By the formula for the derivatives of a resolvent matrix, we have 



,m— «+l J 



(5.25) 



1=1 



Qi 

Q2 

Qs 

Q4 

Qs 



T 

—/=^a+l,m-f^!^l,a-lGjGk ^ a+l,m-a+ll{a<m-a+l}) 



,m—a+l 



1 rp 

1 T 



Introduce the notations 



a ■ — » ci+l,mj 



V, = Vi 



m—a+1 ■ 



From formula (j5.25p it follows that 



a2(U„JRVo 



dX 



E 



dCti 



jk 
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Since all other calculations will be similar we consider the case I = 3 only. Simple calcu- 
lations show that 



(m) 



(5.26) 



where 



p(i 

p(2 
p(3 
p(4 
p(5 
p(6 
p(7 



1. 



-J" 



^ T T 

Uq JRVm_Q,+2eje^. Uq JRVm-a+2eje^ Uq JRVc 



1. 



-U„JRVa+iefe+p„^_^ej-+p^_^^^ 
1 



n 



UaJRVm,-Q,+2ejefc UaJRVo+iefc+p^_^e 



u. 



JRVa 



1 '2^ 



Consider now the quantity, for ^ = 1, . . . , 5, 

-j^ Va-l Pa , 

= ~r X] X] ^ 

n2 



5X 



(5.27) 



kj 



j=l k=l 

We bound L3 only. The others bounds are similar. First we note that 

Pa-l Pa 



EE^^^fc [P^'^]fci = 0, for 1^ = 1,2,3. 

j=i k=i 



(5.28) 



Furthermore, 



E |x]"/||[pW]fcj| < E |x]^)|3|[U„JRV^„,+2]fe,f |[U,JRV,]fcj|. (5.29) 
Let \Ja^^ ( Vq''^^) denote matrix obtained from Uq (Vq) by replacing -'^j^^ by zero. 



We may write 



/j ^ a+l,m—a+l^k+p 



m,_Q6j+p„_„+i"^m-Q!+2,m- 



(5.30) 



and 



V„ = V, 



1 2" 
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Using these representations and taking in account that 



[V, 



a+l,m—a\k,k+pr, 



l,m—a\k,k+p„ 



(5.31) 



we get 



E|x]f ||[P(4)],,| < iElxj^/lllU^JRV^.^+^lfciniUi^'^^^JRVi^-'^lfc,!. (5.32) 



Furthermore, 



|[UaJRVm_a+2]fc,j| < - || Vm-a+2ej ||2 He^Ua || ; 

|[U(^>)JRVP)],,| < i||v(f»e,||2||ejui^»||, 



(5.33) 



Applying inequahties (j5.32p and ()5.33|) and taking in account the independence of entries, 
we get 



(5.34) 

Applying Lemma 15.31 we get 

Pa-l Pa ^ Pa-1 Pa 



-| fa — ± ya ^ fa — ^ ya 



(a) 1 3 
jk I 



(5.35) 



j=l k=l 



j=l k=l 



Assumption ()5.ip now yields 



TEEE|x]?n[P^%,l<Cr„. 



j=i k=i 

Similar we get the bounds for u = 5,G,7 

Pa-l p, 



(5.36) 



and 



^EEEi^£^n[p^^^wi<f^-n. 

j=l k=l 

\L^\ < CTn, /X = 1, ... ,5. 



The bound of the quantity 



Pa-l Pa 



^m = EEe^. 



(a) 



j=l k=l 

is similar. Thus, the Lemma is proved. 



dX 



(a) 
jk 



kj 



(5.37) 
(5.38) 

(5.39) 
□ 
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Lemma 5.7. Under the conditions of Theorem \l.l\ we have 

Pu-l Pv Pv-l Pv 



j=l k=l j=l k=l 



c)V,+i,„,JRVi 



+ £:niz) 



J kj 



and 



Pm—iy Pm — L^-\-l 



3=1 k=l 



Pm — h' Pm — iy-\-l 

E E E 

i=i fc=i 



,m—v+l 

Wk 



j+py-\,k 



where \en{z)\ < 

Proof. We apply Taylor's formula twice, 

E^/(e) = f'{o)Ee + E^Y'(^e)(i - 0), 

and 

/(0)=E/'(C)-Eer(eO (5.40) 

where 9 denotes uniformly distributed r.v. on the unit interval which is independent of ^. 
After simple calculations we get 



Pv-l Pv 



Pv-l Pv 



X X^^^jfc \V^+i^rn3Y(Mi^rn~u+l]kj - X X^ 
j=l fe=l j=l k=l 



9V,+i„JRVi 



9X 



jk 



kj 



Pv-l Pv 



jk 



j=l k=l 

Using the results of Lemma 15.61 we conclude the proof. 



kj 



□ 
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